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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 1 1/13/2009 has been entered. 

Response to Amendment 

2. The amendments filed on 1 1/13/2009 have been entered and made of record. Claims 1-2, 
5-10, 13-14, 17-18, 21-22, and 25-34 are pending. 

Response to Arguments 

3. Applicant's arguments with respect to claims 1-2, 5-10, 13-14, 17-18, 21-22, and 25-34 
have been considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1-2, 5-10, 13-14, 17-18, 21-22, 25, and 31-34 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Okada (US PG PUB 20040057700 Al) in view of Kato (US PG PUB 
2002/0145702) and further in view of Sawabe (US PG PUB 2002/0176695), Jung (US PG PUB 
20040081434) and Herley (US PG PUB 20050066352). 
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Regarding claim 1 , Okada discloses a computer readable medium having a data structure 
for managing reproduction of data recorded on the computer readable medium, comprising: a 
data area storing at least first and second clip stream files (see paragraph 0207 and figs. 1 and 4); 
the first clip stream file including video data representing at least one still image (see paragraphs 
0208, 0211-0212 and 0570); the second clip stream file including audio data; and a playlist area 
storing a playlist file (see figs. 4, 42A-B and paragraphs 0212, 0280-0283). 

Claim 1 differs from Okada in that the claim further requires at least one playitem 
indicating an in-point and out-point of the first clip stream file to reproduce the at least one still 
image, the at least one sub-playitem indicating an in-point and out-point of the clip stream file to 
reproduce the audio data, wherein the at least one playitem further includes the duration 
information indicating a length of time to display the at least one still image when the display 
mode indicates to display the at least one still image for a finite period of time. 

In the same filed of endeavor Kato discloses a playlist area (see figures 7 and 14) 
including a playitem and a sub-playitem, the at least one playitem indicating an in-point and out- 
point of the first clip stream file to reproduce the at least one still image (see figure 63 and 
paragraphs 0449-045 1 and figure 97), the at least one sub-play item indicating an in-point and 
out-point of the clip stream file to reproduce the audio data (see figure 63), wherein the playitem 
further includes the duration information indicating a length of time to display the an image 
when the display mode indicates to display the image for a finite period of time (see paragraphs 
0448, 0451 and figure 97). Therefore in light of the teaching in Kato it would have been obvious 
to one of ordinary skill in the art at the time the invention was made to modify Okada by 
providing a playtime and sub-playitem indicating in and out point, and a finite or infinite still 
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image display mode in order to maintain continuity when reproducing pictures recorded 
separately. 

Claim 1 further differs from the above combination in that the claim further requires a 
display mode indicating to display the at least one still image for a finite period of time if the at 
least one still image is to be displayed for a finite period of time, the display mode indicating to 
display the at least one still image for infinite period of time if the at least one still image is to be 
displayed for an infinite period if time; and a length of time to display at least one still image. 

In the same field of endeavor Sawabe teaches a display mode indicating to display the at 
least one still image for a finite period of time if the at least one still image is to be displayed for 
a finite period of time (see figure 10A, in response with specified time, figure 10B steps 21-23, 
and figure 1 1 steps 40, and 22-23, and paragraphs 0181, 0184-0185, and 0191) the display mode 
indicating to display the at least one still image for infinite period of time if the at least one still 
image is to be displayed for an infinite period if time (see figure 10A in response with infinite 
time, figure 10B steps 21, 24 and 30, figure 1 1 steps 40, and 24-25 and paragraphs 0182, 0186- 
0187 and 0192). Sawabe further teaches a length of time to display at least one still image (see 
figure 1 1 A steps 22 and 23 where the prior art teaches specifying length of time to display the 
still image). Therefore in light of the teaching in Sawabe it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify the above proposed 
combination by providing a display mode in order to perform the reproduction reflecting the 
audience's attention. 

Claim 1 further differs from the above combination in that the claim further requires the 
playlist further includes type information which identifies whether reproduction being indicated 
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by the at least one playitem is synchronized with reproduction being indicated by the at least one 
sub-playitem. 

In the same field of endeavor Jung teaches synchronization information which is added 
into the subtitle data. This synchronization information is used in order to synchronize the 
subtitle data with video images. See figures 10 and 18 (shows play list, play item and sub-title), 
paragraphs 114, 123 and claims 4 and 17. Therefore in light of the teaching in Jung it would 
have been obvious to one of ordinary skill in the art at the time the invention was made to 
modify the above proposed combinations by adding type information which is information used 
to determine to synchronize play item with sub play item in order to reproduce corresponding 
part of selected data. 

Claim 1 further differs from the above combination in that the claim further requires 
including repeat information ID which identifies whether to repeat the reproduction of the sub 
play item. 

In the same field of endeavor Herley teaches an identifier that identifies repeating media 
object (see abstract). Herely further teaches the identifier information is used for generation of 
play lists or the like (see paragraph 0007). See also paragraphs 0084, 0095, and 0212. Therefore 
in light of the teaching in Herely it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the above combination by including repeat 
information Id in order to handle each media objects separately. 

Regarding claim 2, Kato discloses the at least one sub-play item includes an indicator 
indicating that the at least one playitem is related to the at least one sub-playitem such that the 
audio data is played in association with the at least one still image (see paragraphs 0187-0188). 
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Regarding claim 5, Okada discloses the first clip stream file includes video data 
representing more than one still image (see paragraphs 021 1-0212); and the at least one playitem 
indicates to reproduce a number of the still images (see fig. 4 and paragraph 0212). 

Claim 6 is rejected for the same reason as discussed in claim 1 above. 

Regarding claim 7, Okada discloses a method of reproducing a data structure for 
managing reproduction of data recorded on a recording medium, comprising: reproducing at 
least first and second clip stream files from the recording medium, the first clip stream file 
including video data representing at least one still image, the second clip stream file including 
audio data, and reproducing a playlist file from the recording medium, the playlist file including 
at least one playitem and at least one sub-playitem (see paragraphs 0209, 0033, 0703 and 
rejection of claim 1 above). 

Claim 7 differs from Okada in that the claim further requires at least one playitem 
indicating an in-point and out-point of the first clip stream file to reproduce the at least one still 
image, the at least one sub-playitem indicating an in-point and out-point of the clip stream file to 
reproduce the audio data, wherein the at least one playitem further includes the duration 
information indicating a length of time to display the at least one still image when the display 
mode indicates to display the at least one still image for a finite period of time. 

In the same filed of endeavor Kato discloses a playlist area (see figures 7 and 14) 
including a playitem and a sub-playitem, the at least one playitem indicating an in-point and out- 
point of the first clip stream file to reproduce the at least one still image (see figure 63 and 
paragraphs 0449-045 1 and figure 97), the at least one sub-play item indicating an in-point and 
out-point of the clip stream file to reproduce the audio data (see figure 63), wherein the playitem 
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further includes the duration information indicating a length of time to display the image when 
the display mode indicates to display the image for a finite period of time (see paragraphs 0448, 
0451 and figure 97). Therefore in light of the teaching in Kato it would have been obvious to one 
of ordinary skill in the art at the time the invention was made to modify Okada by providing a 
playtime and sub-playitem indicating in and out point, and a finite or infinite still image display 
mode in order to maintain continuity when reproducing pictures recorded separately. 

Claim 7 further differs from the above combination in that the claim further requires a 
display mode indicating to display the at least one still image for a finite period of time if the at 
least one still image is to be displayed for a finite period of time, the display mode indicating to 
display the at least one still image for infinite period of time if the at least one still image is to be 
displayed for an infinite period if time. 

In the same field of endeavor Sawabe teaches a display mode indicating to display the at 
least one still image for a finite period of time if the at least one still image is to be displayed for 
a finite period of time (see figure 10A, in response with specified time, figure 10B steps 21-23, 
and figure 1 1 steps 40, and 22-23, and paragraphs 0181, 0184-0185, and 0191) the display mode 
indicating to display the at least one still image for infinite period of time if the at least one still 
image is to be displayed for an infinite period if time (see figure 10A in response with infinite 
time, figure 10B steps 21, 24 and 30, figure 11 steps 40, and 24-25 and paragraphs 0182, 0186- 
0187 and 0192). Sawabe further teaches a length of time to display at least one still image (see 
figure 1 1 A steps 22 and 23 where the prior art teaches specifying length of time to display the 
still image). Therefore in light of the teaching in Sawabe it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify the above proposed 
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combination by providing a display mode in order to perform the reproduction reflecting the 
audience's attention. 

Claim 7 further differs from the above combination in that the claim further requires the 
playlist further includes type information which identifies whether reproduction being indicated 
by the at least one playitem is synchronized with reproduction being indicated by the at least one 
sub-playitem. 

In the same field of endeavor Jung teaches synchronization information which is added 
into the subtitle data. This synchronization information is used in order to synchronize the 
subtitle data with video images. See figures 10 and 18 (shows play list, play item and sub-title), 
paragraphs 114, 123 and claims 4 and 17. Therefore in light of the teaching in Jung it would 
have been obvious to one of ordinary skill in the art at the time the invention was made to 
modify the above proposed combinations by adding type information which is information used 
to determine to synchronize play item with sub play item in order to reproduce corresponding 
part of selected data. 

Claim 7 further differs from the above combination in that the claim further requires 
including repeat information ID which identifies whether to repeat the reproduction of the sub 
play item. 

In the same field of endeavor Herley teaches an identifier that identifies repeating media 
object (see abstract). Herely further teaches the identifier information is used for generation of 
play lists or the like (see paragraph 0007). See also paragraphs 0084, 0095, and 0212. Therefore 
in light of the teaching in Herely it would have been obvious to one of ordinary skill in the art at 
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the time the invention was made to modify the above combination by including repeat 
information Id in order to handle each media objects separately. 

Regarding claim 8, Okada discloses an apparatus for recording a data structure for 
managing reproduction of data recorded on a recording medium, comprising: a pick up 
configured to record data on the recording medium (see paragraphs 0010, 0146 and 0151, and 
figure 34); a controller (see fig. 34 and paragraphs 0040 and 0146) configured to control the pick 
up to record at least first and second clip stream files, and a playlist file on the recording 
medium, the first clip stream file including video data representing at least one still image, the 
second clip stream file including audio data, the playlist file including at least one playitem and 
at least one sub-playitem (see rejection of claim 1 above and fig. 48). 

Claim 8 differs from Okada in that the claim further requires at least one playitem 
indicating an in-point and out-point of the first clip stream file to reproduce the at least one still 
image, the at least one sub-playitem indicating an in-point and out-point of the clip stream file to 
reproduce the audio data, wherein the at least one playitem further includes the duration 
information indicating a length of time to display the at least one still image when the display 
mode indicates to display the at least one still image for a finite period of time. 

In the same filed of endeavor Kato discloses a playlist area (see figures 7 and 14) 
including a playitem and a sub-playitem, the at least one playitem indicating an in-point and out- 
point of the first clip stream file to reproduce the at least one still image (see figure 63 and 
paragraphs 0449-045 1 and figure 97), the at least one sub-play item indicating an in-point and 
out-point of the clip stream file to reproduce the audio data (see figure 63), wherein the playitem 
further includes the duration information indicating a length of time to display the image when 
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the display mode indicates to display the image for a finite period of time (see paragraphs 0448, 
045 1 and figure 97). Therefore in light of the teaching in Kato it would have been obvious to one 
of ordinary skill in the art at the time the invention was made to modify Okada by providing a 
playtime and sub-playitem indicating in and out point, and a finite or infinite still image display 
mode in order to maintain continuity when reproducing pictures recorded separately. 

claim 8 further differs from the above combination in that the claim further requires a 
display mode indicating to display the at least one still image for a finite period of time if the at 
least one still image is to be displayed for a finite period of time, the display mode indicating to 
display the at least one still image for infinite period of time if the at least one still image is to be 
displayed for an infinite period if time. 

In the same field of endeavor Sawabe teaches a display mode indicating to display the at 
least one still image for a finite period of time if the at least one still image is to be displayed for 
a finite period of time (see figure 10A, in response with specified time, figure 10B steps 21-23, 
and figure 1 1 steps 40, and 22-23, and paragraphs 0181, 0184-0185, and 0191) the display mode 
indicating to display the at least one still image for infinite period of time if the at least one still 
image is to be displayed for an infinite period if time (see figure 10A in response with infinite 
time, figure 10B steps 21, 24 and 30, figure 11 steps 40, and 24-25 and paragraphs 0182, 0186- 
0187 and 0192). Sawabe further teaches a length of time to display at least one still image (see 
figure 1 1 A steps 22 and 23 where the prior art teaches specifying length of time to display the 
still image). Therefore in light of the teaching in Sawabe it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify the above proposed 
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combination by providing a display mode in order to perform the reproduction reflecting the 
audience's attention. 

Claim 8 further differs from the above combination in that the claim further requires the 
playlist further includes type information which identifies whether reproduction being indicated 
by the at least one playitem is synchronized with reproduction being indicated by the at least one 
sub-playitem. 

In the same field of endeavor Jung teaches synchronization information which is added 
into the subtitle data. This synchronization information is used in order to synchronize the 
subtitle data with video images. See figures 10 and 18 (shows play list, play item and sub-title), 
paragraphs 114, 123 and claims 4 and 17. Therefore in light of the teaching in Jung it would 
have been obvious to one of ordinary skill in the art at the time the invention was made to 
modify the above proposed combinations by adding type information which is information used 
to determine to synchronize play item with sub play item in order to reproduce corresponding 
part of selected data. 

Claim 8 further differs from the above combination in that the claim further requires 
including repeat information ID which identifies whether to repeat the reproduction of the sub 
play item. 

In the same field of endeavor Herley teaches an identifier that identifies repeating media 
object (see abstract). Herely further teaches the identifier information is used for generation of 
play lists or the like (see paragraph 0007). See also paragraphs 0084, 0095, and 0212. Therefore 
in light of the teaching in Herely it would have been obvious to one of ordinary skill in the art at 
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the time the invention was made to modify the above combination by including repeat 
information Id in order to handle each media objects separately. 

Regarding claim 9, the limitation of claim 9 can be found in claims 7 and 8. Therefore 
claim 9 is analyzed and rejected for the same reason as discussed in claims 7 and 8 above. 

Claims 10 and 13 are rejected for the same reasons as discussed in claim 2 and 5 
respectively above. 

Regarding claims 14 and 17 are rejected for the same reasons as discussed in claims 2 
and 5 above. 

Regarding claims 18 and 21 are rejected for the same reasons as discussed in claims 2 
and 5 above. 

Regarding claims 22 and 25 are rejected for the same reasons as discussed in claims 2 
and 5 above. 

Regarding claims 31-34, Herely teaches the recording medium is read-only and 
recordable recording medium (see paragraph 0064). 

6. Claims 26-30 are rejected under 35 U.S.C. 103(a) as being unpatentable over Okada (US 
PG PUB 20040057700 Al) in view of Kato (US PG PUB 2002/0145702) and further in view of 
Sawabe (US PG PUB 2002/0176695), Jung (US PG PUB 20040081434), Herley (US PG PUB 
20050066352) and Saeki (US PG PUB 2001/0043790 Al). 

Regarding claims 26-30, although the combination of Okada, Kato, and Sawabe Jung and 
Herley teaches the limitation of claims 1, 6, 7, 8, and 9, the prior arts fails to disclose the 
limitation a clip information area storing first and second clip information files, the first clip 
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information file being associated with the first clip stream file, the first clip information file 
including first mapping information between a presentation time and a unit of the first clip 
stream file, the second clip information file being associated with the second clip stream file, the 
second clip information file including second mapping information between a presentation time 
and a unit of the second clip stream file for the second clip stream file. 

In the same field of endeavor Saeki discloses a clip information area storing first and 
second clip information files, the first clip information file being associated with the first clip 
stream file, the first clip information file including first mapping information between a 
presentation time and a unit of the first clip stream file, the second clip information file being 
associated with the second clip stream file, the second clip information file including second 
mapping information between a presentation time and a unit of the second clip stream file for the 
second clip stream file (see figures 6, 9, col. 12 lines 1-34, col. 15 line 29-col. 16 line 4, and also 
figures 7A and 7B). Therefore in light of the teaching in Saeki it would have been obvious to one 
of ordinary skill in the art at the time the invention was made to modify the proposed 
combination by providing clip information file associated with clip stream file, and mapping 
information between presentation time in order to control the data. 



Conclusion 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HELEN SHIBRU whose telephone number is (571)272-7329. 
The examiner can normally be reached on M-F, 8:30AM-5PM. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, THAI Q. TRAN can be reached on (571) 272-7382. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/HELEN SHIBRU/ 
Examiner, Art Unit 262 1 
January 31, 2010 



